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Abstract 

Recently a novel concise representation of the probability distribution of heat con- 
ducting nonequilibrium steady states was derived. The representation is valid to the 
second order in the "degree of nonequilibrium" , and has a very suggestive form where 
the effective Hamiltonian is determined by the excess entropy production. Here we 
extend the representation to a wide class of nonequilibrium steady states realized in 
classical mechanical systems where baths (reservoirs) are also defined in terms of de- 
terministic mechanics. The present extension covers such nonequilibrium steady states 
with a heat conduction, with particle flow (maintained either by external field or by 
particle reservoirs), and under an oscillating external field. We also simplify the deriva- 
tion and discuss the corresponding representation to the full order. 
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1 Introduction 

To construct a statistical mechanics that applies to nonequilibrium states is one of the most 
challenging unsolved problems in theoretical physics. See pQ and references therein. By a 
statistical mechanics, we mean a universal theoretical framework that enables one to precisely 
characterize states of a given system, and to compute (in principle) arbitrary macroscopic 
quantities. The canonical distribution for equilibrium states, in which the probability of ob- 
serving a microscopic state 7 is given by ^(7) oc exp[— (3 if (7)], is a paradigm for a statistical 
mechanics. 

It is, however, quite unlikely that there exists a statistical mechanics that applies to 
any nonequilibrium systems. A much more modest (but still extremely ambitious) goal is to 
look for a theory that applies to nonequilibrium steady states, which have no macroscopically 
observable time dependence but have macroscopic flow of energy or material. There may 
be a chance that probability distributions for nonequilibrium steady states can be obtained 
from a general principle that is analogous to the equilibrium statistical mechanics. 

If we restrict ourselves to those models with extremely small "order of nonequilibrium" , 
the linear response theory provides us with a more or less satisfactory answer. See, for 
example, [2j. One can represent steady state distribution and various physical quantities 
by using time-dependent correlation functions in the corresponding equilibrium state. But 
the restriction to the linear order is unsatisfactory at least from a purely theoretical point 
of view. It is highly desirable and challenging to obtain similar expressions which works 
beyond the linear response regime. 

In fact, formal expressions of the steady state distribution which are exact to full order 
were derived and discussed, for example, by McLennan [3], Zubarev [4], and Kawasaki and 
Gunton [5]. See (I3.14p for an example of such expressions. But such expressions, as they 
too formal and do not directly provide us with meaningful information about the 
nature of nonequilibrium steady states. See section 13.41 Such expressions were indeed used 
as starting points of further explorations of nonequilibrium steady states. 
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In a recent progress (which is of course closely related to previous works that we have 
mentioned) in nonequilibrium physics, deep implications of the microscopic time-reversal 
symmetry were revealed j6j EJ El El EEl El H2j- It was shown that seemingly simple sym- 
metry has rich and meaningful consequences including the fluctuation theorem and the 
nonequilibrium work theorem. 

In this connection, two of us (Komatsu and Nakagawa) studied the heat conducting 
nonequilibrium steady state realized in a system attached to multiple heat baths, and ob- 
tained a novel concise representation of the steady state distribution [13]. The representation 
is written in terms of the (excess) entropy production at the heat baths, and is correct to 
the second order in the heat current. 

Although the result of [13j is also based on the time-reversal symmetry, it stands out 
from the previous works in the following two points. First this result directly addresses 
the question about the precise form of the probability distribution in nonequilibrium steady 
states. Secondly [32] presents a non-exact result which is valid up to the second order in 
the heat current. We regard this restriction as a merit rather than a fault. By looking only 
at exact relations, one is tempted to be satisfied with rather formal results which do not 
focus strongly on desired physics of nonequilibrium states. Well controlled result for small 
"degree of nonequilibrium" (like the one in [13]) may suggest various nontrivial natures of 
nonequilibrium steady states. 

We expect that this suggestive representation can be a starting point of further develop- 
ments of nonequilibrium physics. In fact we have made use of this representation to derive 
thermodynamic relations for nonequilibrium steady states |14j . 

In the present paper, we do not go into applications of the representation of [13J, but 
rather focus on its more basic aspects. We shall discuss some extensions, and also present 
an efficient derivation of the representation. 

In [T3], the representation was derived for stochastic processes. Since the essence of the 
representation is the microscopic time-reversal symmetry, this restriction is by no means 
essential. Here we shall present a derivation of the representation for general models of 
nonequilibrium steady states which are described entirely in terms of deterministic classical 
mechanics. More precisely, we design the whole system (including the heat or particle reser- 
voirs) using deterministic mechanics. By letting the whole system evolve for a sufficiently 
long time, we get a nonequilibrium steady state (in a small part of the whole system). We 
can treat nonequilibrium steady states with a heat conduction or with a particle current 
(maintained either by non-conservative external force or by particle reservoirs with different 
chemical potentials). We can also treat a nonequilibrium state which is maintained by an 
oscillating external force. 

In [T3], only the lowest order of the representation was discussed in detail (because of 
the limitation of the space). We here discuss the corresponding formal representation which 
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is valid to the full order in the "order of nonequilibrium." The derivation here is essentially 
the same as that in [13], but we have refined the argument so that to make it as transparent 
as possible. 

The present paper is organized as follows. In section [2} we carefully describe our setting, 
and how one can realize a nonequilibrium steady state in a system described by determinis- 
tic (Hamiltonian or Newtonian) mechanics. In section [3X we introduce the notion of excess 
entropy production, and describe the main representation. In section HI we derive the rep- 
resentation. Finally, in section [5} we formulate nonequilibrium steady states with particle 
flow, and extend the representation. 

2 Setting 

In the present section, we carefully describe the problem that we study. In short, we construct 
deterministic classical mechanical systems of many particles which faithfully model typical 
situations where we expect to have nonequilibrium steady states. 

2.1 States and static Hamiltonians 

We consider a situation where a "system" is attached to n large heat baths with different 
temperatures. We shall model the whole system as a classical mechanical system which 
consists of n + 1 distinct parts. The first part is the syste while the latter are the heat 
baths. We assume that the different parts do not exchange particles, but the system and 
each heat bath may exchange energy. 

By T s = (r^, . . . , rjy ; pf , . . . , p^ ) we collectively denote the coordinates and momenta 

of the system, which contains N s particles, and by Tj = (r[ , . . . , rjj..; p± \ . . . ,p$.) the co- 
ordinates and momenta of the i-th heat bath, which contains Ni particles. By S s and Si, we 
denote the phase spaces of the system and the z-th bath, respectively. T — (I\? Tx, . . . , r n ) 
denotes the coordinates and momenta of the whole system. The corresponding total phase 
space is S = S s x <Si x • • • x S n . Finally dT s , dYi and dT denote the Lebesgue measures 
on S s ,Si and S, respectively. For any state T = (T s , r 1; . . . , T n ) 6 S, we denote by 
T* = (r*, r*, . . . , r*) e S its time reversal, namely, the state obtained by reversing all 
the momenta, e.g., (r*;p)* = (r; —p). 

The static Hamiltonian of the whole system is written as 

n 

iWr) = H S (T S ) + Y,{^ h \T l ) + H^iT^)}, (2.1) 

i=i 

4 In what follows "system" always means the first part. The collection of the n + 1 parts is referred to as 
the "whole system" . 
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Figure 1: The whole system consists of a "system" on which we shall focus and several 
heat baths. Hamiltonians H s , H^ b \ and describe the "system", the z'-th bath, 
and the coupling between the "system" and the z'-th bath, respectively. We also write 

4 b) (r,) + ^ c) ' 



H i {T) = H\ b \V i ) + H\ c \V i ,T s 



where H S (T S ) is the Hamiltonian for the system, H\ is that for the z'-th bath, and 
h\ {Vi, r s ) describes the coupling between the z'-th bath and the system. See Fig. [TJ In 
many cases, we use the total Hamiltonian for the z'-th bath 

H i (r) = Ht\r t ) + Hl c \r l ,r s ). (2.2) 

We assume that all the Hamiltonians have time-reversal symmetry, i.e., if stat (r) = 
# stat (r*), H S (T S ) = H S (T* S ), and H^V) = Hi(T*) for i = 1, ... ,n. A typical choice is 

N s I (8) 1 2 

H s (T s ) = J^ l -^ + V s (r?,...,r^), (2.3) 

I W|2 

^ W (r*)=E^l + V i (r« ...,rW), (2.4) 

^ o) (r 4) r.) = y M (r« ...,r«;r« ...,r«), (2.5) 

where the potential V s and Vi represent both the external single-body forces (such as those 
from the walls) and the interaction between the particles. The potential Vt s represents the 
interaction between the particles in the z'-th bath and in the system. 



2.2 Time evolution 

We denote by T : S — > S the time evolution map of the whole system from time t — to 
t = T. More precisely if the state at t = is T, then the state at time t = T is T(T). By 
(T(r)) s G S s , we denote the state (i.e., coordinates and momenta) of the system in T(T). 
(More generally (r) s G 5 S denotes the projection of T G S onto «S S .) We do not make the 
T-dependence explicit since T is mostly fixed. 
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Figure 2: Schematics for the trajectory T -w T(T) and its time reversed trajectory 
7~ _1 (r*) -v* r*. The state T* is the time reversal of the state T. 

The time evolution map T may be that generated by the static Hamiltonian (12.11) . but 
may be much more general (see section [2751 for examples). All that we require are that T 
preserves the Lebesgue measure of the total phase space S (which is the statement of the 
Liouville theorem), and that it satisfies the time reversal symmetry 

(T(r))* = r _1 (r*), (2.6) 

for any Y G S, where T _1 is the inverse time evolution, i.e., the inverse function of T . See 
FigfSJ One has the symmetry (12.61) in a general Newtonian dynamics without a magnetic 
field. 

For an arbitrary function /(•) on S, we define its time reversal /^(-) by 

f(Y):=f(T-\Y*)), (2.7) 

for any Y G S. Intuitively speaking, /*(•) is basically the same thing as /(■), but represented 
as a function of the "final state" at t — T. 

Since we are considering a deterministic mechanical system, the initial state Y determines 
the whole trajectory from t — to t — T. Some function f(Y) on S should better be 
interpreted as a function of the whole trajectory Y ~» T(Y) rather than the initial state Y. 
(A notable example of such a function is the entropy production defined in ( 13. II) .) In such 
a case, the time reversal f'(Y) is interpreted as a function of the time reversed trajectory 
J- l {Y*) -w r*. 

2.3 Initial distribution and the steady state 

Let (3i, 02, . . . , f3 n be the inverse temperatures of the heat baths, which we shall fix. Let us 
denote them collectively as /3 = (3%, . . . ,/3„). For any given v G S s , we define the initial 
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distribution as 



i n 

p„(r) = 6(t s - V ) — ex P [- g A {^ b) (r.) + ^ c) (r„ r s )}] , (2.8) 

where the system is fixed at the given state is, and the heat baths are in the corresponding 
equilibrium with inverse temperatures (3. We do not make the (3 dependence of P v iX) 
explicit. In (12.81) . the partition function Z v ((3) is determined by requiring that f dTP u (T) = 
1. From (12.81) . we see that 

/n 
dv 6(v s - is) ex P [- J2 A {^ (b) (r.) + ^ c) (r„ r s )} 
i=i 

n „ 

= J] / dT, exp[-A {H^iTj + Ht\T u y)}]. 
i=i ^ 



(2.9) 



Thus Z v ((3) is a product of the equilibrium partition functions with the "boundary condition" 
v. Let 

Z(P) := n / dTi exp[-A H^pi)], (2.10) 

i=l ^ 

be the similar (but z/ independent) partition function without coupling terms. The "free 
energy" for the coupling between the system and the baths defined as 

<pW(y) :=-lo g 5^, (2.11) 

r zip) V ; 

appears in our representation. Let us stress that Lp^{y) is a combination of equilibrium 
quantities with different temperatures, and is in principle computable. In the weak coupling 
limit, which is standard in the literature, one neglects the effect of the coupling ^^(r,-, v) 
(except for that needed to get steady states). In this limit one can simply set ^ c \is) = 0. 

Let us assume that the state at t = is drawn from the distribution (12.81) . and consider 
the state of the system at t — T. By definition the probability density of finding the system 
at state 7 G S s is 

p v (j) = fdT P V (T) 5((T(T)) S - 7). (2.12) 



We assume that the heat baths are so large that their states won't change essentially 
for quite a long time (see the remark below). This means that each heat bath essentially 
remains in the equilibrium with the inverse temperature specified in the initial state (12. 8p . 
Then there exists a range of time which is short enough for the heat baths but long enough 
for the system. Within such a time scale, the system is expected to settle to a unique 
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nonequilibrium steady state which is independent of the initial state u, and is characterized 
by the inverse temperatures (3 of the heat baths as well as other nonequilibrium conditions 
(see the examples below). 

Suppose that T is chosen from this range. We can then reasonably assume that 



where p s t(7) denotes the probability distribution in the unique nonequilibrium steady state. 

Remark: It is possible to define an artificial heat bath which maintains equilibrium for an 
arbitrarily long time. The bath consists of classical particles confined in a three dimensional 
box defined by < x, y < i and < z < L. The particles do not interact with each other 
and are reflected elastically by the walls. The face with z = is attached to the system, 
and the particles in the system and those in the bath interact through short range repulsive 
interaction. 

In the initial state (12.81) . the particles in the bath are uniformly distributed in the box 
(except near z — 0), and their velocities are exactly distributed according to the Maxwell- 
Boltzmann distribution. As the whole system evolves, the Maxwell-Boltzmann distribution 
may be lost by the interaction between the system and the bath. But those "nonequilibrium 
particles" simply fly away to the positive z direction, and won't come back until it is reflected 
back by the wall at z — L. This means that the bath looks exactly as in equilibrium from 
the system for a finite amount of time. By making L large with the density fixed, we can 
realize a bath which is effectively in equilibrium for an arbitrarily long time. 

We note that this bath, which lacks relaxation process, does not provide a model of 
realistic large baths. But it shows that our assumption is satisfied in at least one example. 

2.4 Conditioned average 

For an arbitrary function /(•) on S, and any u, 7 e S s , we define the conditioned average 



Note that this may be interpreted as the average over all the histories in which the system 
is initially at v and finally at 7. To consider the average in which both the initial and the 
final conditions are specified was an essential idea in [13J, on which the present work is also 
based. 

In addition to the conditioned average (12.141) . we define two kinds of partially conditioned 
averages. One is 



Pi/ (7) = Pst (7), 



(2.13) 



/dr/(r)p y (r)<y((T(r)) g - 7 ) 



(2.14) 




(2.15) 



8 




(2) 



eq 




(4) 



^2,^2 



Figure 3: Four typical examples to which our general theory apply. (1) Heat conduct- 
ing system described by a pure Hamiltonian mechanics. (2) Newtonian system with 
a constant driving force. (3) Hamiltonian system with an oscillating external field. 
(4) System with particle flow (and heat conduction) maintained by two reservoirs with 
different chemical potentials. 



which is a natural average when the initial distribution P V {T) is specified. By taking into 
account the assumption that the unique steady state is attained at t — T, we have written 
the final state as "st" (which stands for steady state). The other average treats the opposite 
situation, where the system starts from the steady state and ends precisely at the specified 
state 7 G T s . It is defined by averaging {f)„ a over the initial state as 

(/)st, 7 := J du Pst (y){f) u>T (2.16) 

2.5 Examples 

Let us describe typical examples to which our general theory apply. 

In what follows, we mean by "equilibrium case" the situation where $ = f3 eq for all i with 
some /3 eq > 0, and the time evolution T is the pure Hamiltonian time evolution determined 
by the static Hamiltonian ( 12. ip . 

We shall consider models in which certain nonequilibrium features are added to this 
"equilibrium case." See Fig. [31 There can be many examples that fit into our general 
scheme, but let us discuss three typical cases. In all the examples (and in general), we 
denote by e > a dimensionless quantity that measure the "degree of nonequilibrium" . The 
equilibrium case corresponds to e = 0. 

1. Heat conduction: 

We let the number n of the heat baths to be more than one, and assume that (3\,...,(3 n are 
different. The time evolution T is the pure Hamiltonian time evolution determined by the 
static Hamiltonian (12.11) . Then there should be a nonvanishing heat current in the steady 
state. We take e to be proportional to the heat current. 
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2. Driven system (DC field): 

We let n = 1, and /3 X = /? eq . Suppose that the particles in the system are confined in a box 
with periodic boundary conditions in one direction, say the x-direction. We assume that 
particles feel external driving forces (proportional to e) in the x-direction. One may imagine 
that there is an "electric field" in the x-direction and exerts the electrostatic force on charged 
particles. Since such an external drive cannot be modeled by a Hamiltonian dynamics (when 
we use periodic boundary conditions), we consider a Newtonian dynamics in which the force 
on a particle is the sum of the external driving force and the force determined by the static 
Hamiltonian ( 12. ip . It is crucial that the Liouville theorem and the time reversal symmetry 
( 12. 6p still hold for this dynamics. 

3. Driven system (AC field): 

We again let n = 1, and (3\ = /3 eq . We consider the situation where particles are acted by a 
force which varies periodically in time. A typical example is a system under an oscillating 
electric field. After a sufficiently long time, the system is expected to settle into a periodically 
varying state with the same period as the external force. By looking at the state when 
external force has a fixed phase, one effectively observes a "steady" state. We wish to focus 
on such a sate (and call it a steady state with a slight abuse of the terminology). 
The time evolution T is determined by a time dependent Hamiltonian 

H 8t3 , t (T) + eV t (T 8 ), (2.17) 

where V t (T s ) is a periodically changing potential. The dynamics satisfies the Liouville the- 
orem. In order to guarantee the time reversal symmetry (12.61) . we further assume that the 
potential satisfies Vt(r s ) = Vr_t(r s ). 

Clearly one can consider models in which these three nonequilibrium factors (and other 
possible factors) are combined. But we believe that to have these three typical examples in 
mind will be helpful in understanding the general representation that we shall derive. 

In section [5], we treat a situation in which the system and the baths (reservoirs) exchange 
particles. Then one can realize 

4- Particle flow maintained by a difference in chemical potentials: By considering a system 
attached to multiple reservoirs with different chemical potentials (and possibly with different 
temperatures) and allowing the system and the reservoirs to exchange particles, one can 
realize a nonequilibrium steady state with a constant flow of particles (and possibly with a 
heat conduction). See section [5] for details. 
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3 Representations of /? s t(7) 



In the present section, we describe the representations ( 13. 71) and ( 13. lip of the steady state 
distribution. For this purpose we define relevant quantities carefully in section 13.11 We also 
compare the present representation with the existing similar results in section 13.41 



3.1 Entropy production and excess entropy production 

For r e S, let us define 



e(r):=^A{^(T(r))-^(r)}, (3.1) 



where H^T) is the total Hamiltonian for the i-th bath defined in (12. 2p . Note that Hi(T(T)) — 
Hi(T) can be interpreted as the total heat that has flown from the system to the i-th heat 
bath_| during the time interval from t = to t = T. Thus O(r) defined in (13. ip is the total 
entropy production due to the transfer of heat into the n heat baths. Although 0(r) is 
defined here as a function of the initial state V £ S, it may be more naturally regarded as a 
function of the whole trajectory from t — to t — T. In fact by denoting ji(t; T) the heat 
current that flows into the i-th bath at time t in the trajectory T -w T(T), one has 



9(r)=VA/ dtji(t;T)= [ dta(t;T), (3.2) 
„_i Jo Jo 



where 

n 

a(t;T) :=^Aj;(t;r) (3.3) 
i=\ 

is the entropy production rate. 

In a nonequilibrium steady state, there should be a constant flow of heat into (or from) 
heat baths resulting in positive constant entropy production rate. Therefore the average like 
(@)i/, 7 should grow linearly with time T. Let us define the entropy production rate a as 

?: =UmI<e>., (3.4) 



5 In this definition of heat, we interpreted the energy from the coupling Hamiltonian H[ c ^{T il T s ) as a 
part of the energy of the bath. In fact we do not have a convincing physical argument for justifying this 
particular choice. We use this definition only because we can derive the main representation by using it. Of 
course this delicate issue becomes irrelevant in the weak coupling limit. 
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where the average may be any of the three kinds (12.141) . (I2.15p . (12.161) that we have defined 
since the long time behavior should not depend on the initial and the final conditions. Here 
T — > oo means "make T large in the range which is not too large for the heat baths." 

Then by subtracting the steady contribution from the total entropy production, we define 
the excess entropy production as 

6 cx (r) :=e(r)-ffT= f dt{a(t;T) -a}. (3.5) 

Jo 

We recall that the similar excess quantities plays a fundamental role in the phenomenological 
approach to nonequilibrium steady states [T5| ITS]. 

3.2 The second order representations 

Now we shall state our major result. Let us write the steady state distribution as 

p st (j) = exp[-^ st (7)], (3.6) 

where f s t{l) is the "effective Hamiltonian" which plays a role of the quantity (3 eq H s ( / -f) in 
equilibrium. 

The most important result of the present paper is the concise representation (obtained 
in [13]) of the steady state distribution 

^ st ( 7 ) = ^ (0) + ¥? {c) ( 7 ) + ^{(©cx) r ,st - (© CX )st, 7 } + 0(6 3 ), (3.7) 

where (p^ is a normalization constant^ independent of 7 (but of course dependent on (3 and 
other nonequilibrium parameters). The "free energy" of the coupling (p^ c '(j) defined in (12.111) 
is an equilibrium quantity which becomes negligible in the weak coupling limit. Thus the 
only nonequilibrium quantities contained in the right-hand side of (13 .7p are the expectation 
values of the excess entropy production O ex - Since 9 ex may be regarded as a quantity of 
first order in e, one may naturally expect that the representation (13.71) is correct up to the 
first order in e. Rather surprisingly, we shall show that (as indicated in the error term in 
(13. 7p ) this representation is correct to the second order in the degree of nonequilibrium e. 

We indeed have an expression to the full order in e as in (14.171) . But the above second 
order expression seems most useful and suggestive. 

Let us examine the two conditioned expectation values that appear in (13.71) . Recalling 
the expression (13.51) of the excess entropy production, the first expectation value is written 
as 

(©e X ) 7 *,st = / dt (a(t) - a) 7 * iSt . (3.8) 
Jo 

6 In |14j . we found that the normalization constant plays the role of the entropy of the nonequilibrium 
state. 
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Since the average of a(t; V) in the steady state is a, the integrand is vanishing except for 
small values of t where the system is forced to be out of the steady state by the imposed 
initial condition. Thus the integrand in ( 13.81) is non- negligible only for t < r*, where r* 
is a constant which is sufficiently larger than the relaxation time of the system. Likewise 
the other average (0 ex )st,7 is essentially determined from an integral from T — r* to T. We 
thus find that the representation (13. 7p converges rapidly when T is increased beyond the 
relaxation time. 

The representation (13. 7p has a very interesting form which contains the difference between 
the two conditioned averages of the excess entropy production. Since it turns out that 
(©ex) 7*, st = — (@ex)st,7 + 0(e 2 ), the two terms roughly have comparable contributions. But 
to get the result which is precise to 0(e 2 ), it is necessary to consider the difference of the 
two averages. 

3.3 Relation to the canonical distribution 

By fixing a reference equilibrium inverse temperature /3 eq , and using the energy conservation, 
we can rewrite the representation (13. 7p in a different form, in which the contributions from 
the canonical distribution becomes clearer. 
Let us define 

$(r) := 0(r) + p cq {H s ((T(T)) s ) - H S (T S )}, (3.9) 

which we may call the "nonequilibrium part" of the entropy production. Here /3 eq is the 
reference inverse temperature, which may be chosen rather arbitrarily. 

By recalling the definitions of the static Hamiltonian (12.11) and the entropy production 
(13. ip . we see that 

/i 

$(T) = ^W(T) + ]T APiiHiiTp)) - H^T)}, (3.10) 

1=1 

where A(3i = Pi — /3 eq and W(T) = if stat (T(r)) — H stat {T) is the total work that was done 
(say, by the external force) to the whole system from t — to t — T. Note that in the 
example 1 of heat conduction, we have H^(r) = because of the energy conservation. On 
the other hand, in the example 2 and 3, we have Afy = and the second term of (13.101) is 
vanishing. 

Since O(r) and $(r) differs only by a quantity which depends on the initial and final 
states of the system, the averages (<3>) 7 * iSt , ($) s t,7 grow linearly as aT with the same a as in 
(13. 4p . We therefore define the corresponding excess quantity as $ ex (r) : = $(r) — aT. Then 
the representation (13.71) is rewritten in the form 

Ml) = + ^ (C) (7) + & q #s(7) + ^{($cx>7*,st " ($cx>st, 7 } + ( e3 )> I 3 " 11 ) 



13 



where the new constant is defined by 

3.4 Comparison with known formulas 

We shall here compare our representation (13 .7j) and (13.111) with two of the well-known rep- 
resentations of the steady distribution. 

First is the linear response theory. Indeed it is automatic to get a representation correct 
up to 0(e) if we have a representation which is correct to 0(e 2 ). By starting from the 
representation ( 13. lip , and only taking the lowest order contributions, one arrives at 

Ml) = ^ + ¥? (C) (7) + & q ff.(7) + ^{(^ - <*>^} + 0(e 2 ). (3.12) 

Here (■ • • ) e=0 denotes the conditioned averages as in (12.151) and (j2.16j) . defined in the corre- 
sponding "equilibrium case" with e = 0. We also replace the steady state in the initial or 
final conditions by the equilibrium state (as is indicated by the subscript "eq"). The aver- 
aged quantity $ in (13.121) . on the other had, is a genuine nonequilibrium quantity (13.101) . By 
using the time reversal symmetry (I4.22p . which implies (&) e ^ cq = — (^)lq^y, the expression 
(I3.12p can be simplified as 

Ml) = M + Mil) + & q #s(7) - <*>5 + 0(e 2 ). (3.13) 

The expression ( 13.131) is the standard result of the linear response theory, and may be 
used to derive well-known useful expressions of, say, transport coefficients. We wish to stress 
that our representation (13. lip is as concise as the linear response relation ( 13 . 131) but properly 
takes into account nonlinear effects. 

Next we shall focus on exact expressions for the steady state distribution. By using the 
same notations as before, one can (rather formally) show that the steady state distribution 
is written as 

Pst(l) = const. Z 7 (/3) (e~ e ) 7 . i70 , (3.14) 

where 70 € S s is an arbitrary fixed reference state. See the end of section 14.21 This is one 
of the well-known exact expressions for steady state distribution which were discussed by 
many authors including Zubarev, McLennan, and Kawasaki and Gunton [SJ HI [5] . 

Although (I3.14p somehow resembles our (13 .7p . there are indeed marked differences. First 
of all, (I3.14p is an expression for the distribution itself and hardly provides information 
about the "effective Hamiltonian" <£> s t(7) = — l°gPst(7)- Moreover it is crucial that the bare 
entropy production 6 (rather than the excess entropy production 9 ex ) appears in (I3.14p . 
Since the quantity 6 typically grows as aT in the steady state, the T — ► 00 limit of (13.141) 
is extremely delicate. It is expected that the quantity e _e exhibits wild fluctuation, and a 
miraculous cancellation leads to a result which is independent of T. 
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On the other hand, our expression (13. 7p has a nicely controlled large T behavior. What 
we have in (13.71) are essentially short time integrals of the excess entropy production. This 
is indeed true for our higher order expressions (14.171) . 

To conclude, although the exact but formal expression (13. 14f) and our representation (13.71) 
apparently look similar, their natures are drastically different. 



4 Derivation 

Let us discuss the derivation of the results in detail. 

In section I4.1[ we derive the basic identity (14.11) . which represents the time-reversal 
symmetry in the present system. The derivation is a straightforward application of the 
standard idea repeatedly used, for example, in [TQl [TTJ [12] . 

In sections 14.21 and 14. 3\ we derive the representation ( 13. T[) . The basic idea is essentially 
the same as that in |13| . but we have refined the derivation to make it as efficient and 
transparent as possible. We note that although our derivation is quite sensible in physicists' 
standard, it is not (yet) a mathematical proof. We believe that some new ideas are required 
to construct a true proof. 



4.1 Basic Identity 

We first show the identity 

Z vP Ai) (fe~ 0/2 )^ = Z rPr (v*) (/te- / 2 )^, (4.1) 

which is valid for an arbitrary function /(■) on S. Here and in what follows, we drop the 
(3 dependence of Z v . We note that this identity is a formal consequence of mechanics (and 
the choice of initial distribution), and is independent of the assumption (12 . 1 3[) about the 
approach to steady state. Let us also note that by dividing (14.11) by the same equation with 
/(■) = 1, we get an interesting identity 

(/ e Q// _ (/t e e / )tv* 

(e- 0/2 >,, 7 ~ (e- / 2 ) r ,,* ' 1 ' ' 

which reveals a beautiful time-reversal symmetry in a system far from equilibrium. 
Let us show (14.11) . From the definitions ( 12. 8ft and ( 12.141) . we find 

/n 
dT f(T) exp [- ]T pi HiiT)] 5(T S - u) 5{{T{Y)) B - 7 ). (4.3) 
i=i 
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Then by using this and the definition (13.11) of the entropy production, the left-hand side of 
(14. ip becomes 



ZuPu(i) (fe~ e/2 ) 



"i7 



dr f(v) ex P [-- £ A + ^(r(r))}l 5(r s - u) 5((T(r)) s - 7 ) 



i=i 



Here we shall make a change of variable according to T = T(T). Since the measure preserving 
nature of T ensures dT = dT, we have 

dr f{T-\T)) exp [-1 £ A{^(T _1 (T)) + ^(T)}] ^(T^T)). - i/) 5(T S - 7 ) 

t=i 

By noting that T-\T) = (T(T*))* (as in /(T-^T)) = /t(T*) (as in (IX7jl ). dT = 

dT*, and Hi(T) = Hi(T*), we can rewrite the above as 



dT* f\T*) exp [-- (3i{Hi(T(T*)) + fl,(T*)}l S((T(T*)) S - u*) 5((T*) S - 7 *) 



i=i 



By rewriting Y* as T, we have 



f r 1 - i 

= y /t(r) exp [--J] A{^(r) + fli(r(r))}J 5(r s - 7 *) 5((T(r)) s - O 

By comparing this with the second line of the present equation, we find that 



7* 



(4.4) 



4.2 Derivation of the representation 



By setting /(■) = 1 in (14. ip . and noting that and Z y = Z v * because the Hamilto- 

nians are symmetric under time reversal, we see that 



p T {v*) Z v * (e- / 2 ) 



f,7 



(4.5) 



Pv (j) " Z, ( e - e / 2 ) r ^- 
By writing p u (j) = exp[— <^( 7 )], and recalling (12.111) . we have 

vM _ = ^(c) (7) _ + ^(e- / 2 )^ - log(e- / 2 > 7 ^. (4.6) 
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To proceed further we make use of the standard technique of cumulant expansion. For 
any random variable Y (associated with an average (•••)) and a positive integer k, we define 
the k-th order cumulant of Y by 



(Y k ) c := _log(exp[uYl> 



(4.7) 



u=0 



Then one has a formal Taylor expansion 

lo g< ey > = £^< yfe > c - ( 4 - 

By using (14.71) . one has 



k\ 

k=l 



<yy = (y), (Yr = (r 2 ) - «r» 2 . (4.9) 

It is also useful to note that for any nonrandom y , (14.71) implies 

((Y - y ) k ) c = (Y k ) c , (4.10) 

for k — 2, 3, . . . (but not for k = 1). 

By applying the formal expansion (14.81) to (14.61) . we have 

k=l 

Now let us assume that T is large enough and nonequilibrium steady state is realized in 
the system. Then we can replace the distribution ^p u {l) by <^st(7)- 

We see that the cumulant expansion in (14. lip also simplifies in this limit. Let us examine 
the terms with k = 1. By using the integral representation (13. 2\i of O(r), we have 

(e)„, 7 - (e> 7V . = / dt{(a(t)) vn - Ht))^*} 

Jo 

T 

dt{{a{t)-a) va - (cr(t) -cr) 7V *}, (4.12) 

where a is the entropy production rate (13.41) . Since the average of cr(t; T) equals a in the 
steady state, the expectation values in the right-hand side of (14. 12f) are nonvanishing only 
for t which are either very close to or very close to T (see the discussion below ( 13.81) ). This 
means that we can safely decompose the expectation value as 

dt (a(t) - o% >7 = / dt (a(t) - o% jSt + / dt (a(t) - o% tl7 
Jo Jo 

= (e ex )^ t + (e ex ) sti7 (4.i3) 
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where the expectation values are defined in (12.151) and (I2.16p . By using the similar decom- 
position for the other expectation value, (14.121) leads to 

(e)„, 7 - (e) 7V » = (e ex )^ st + (e ex ) stj7 - (e ex ) 7 * iSt - (Q^)^* (4.14) 

where we used the definition (13.51) of the excess entropy production. 
We will later show (see section 14.41) that analogous result 

(eX - (Q%^ = (Q% st + (e fc >^ i7 - <e fc > 7Vt - (e fc >^ (415) 

holds for k > 2. 

By substituting flOijl and (HTLBD into (EH), we get 

^t(7)-^t(^) = ^ (c) (7)-^ (c) K) 



(-1) k 

+ E Wr^( -) fc ) c ^ + ((©ex) fc ): ti7 - <(e cx ) fc > 7 ,, st - ((e ex ) fc )^,}, 



2 k k\ 

k=l 



(4.16) 



where we noted that flgUD implies (Q k ) c = ({Q ex ) k ) c for k > 2. Note that fOHjl is a sum 
of quantities each of which depends either on 7 or v. Since (I4.16P is valid for any 7, v e iS s , 
we must have 

^st(7) = V (0) + ¥? (c) (7) + £ Vlf {((0ex)fc) ^ - « ») fc >7*,sJ, (4-17) 

fc=i 

for any 7 6 5 S with a constant Lp(°\ This is our full-order representation for the "effective 
Hamiltonian" y?st(7) of the nonequilibrium steady state. Below in section H~4"l we shall see 
that both ((0 ex ) fc )g t and ((9 ex ) fc ) 7 » st grow linearly with T for > 2, but the difference has 
a well-behaved large T limit. Let us also note that one can formally rewrite (14.171) into a 
compact form as 

Ml) = ^ (0) + ¥? (C) (7) - log /Cll?"' 7 • ( 4 - 18 ) 

\C /7*,st 

Finally let us show (13. 14|) for completeness. By setting f(T) = exp[0(r)/2] in (14. ip . and 
using (12.131) . one gets 

Z vPv {i) (1)^ = Z rPr {v*) (e~ e ) r ^. (4.19) 
Then we fix v to an arbitrary constant 70 to get (13.141) . 

Remark: The full order expression like (14.171) is indeed not unique. Take a real constant a 
with < a < 1. By setting / = exp[{a - (1/2)} 0] in fi~T]) . one gets 



Pj *(u*) _ Z v * (e- Qe ),, 
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Puiri) z, (e-^)%*, v * 
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(4.20) 



By combining this with the similar relation obtained by replacing a with 1 — a, we have 



This reduces to (14.51) if we set a = 1/2. 

By using (14.211) instead of (I4.5p . we get an expression corresponding to (I4.17p . It turns 
out that the term with k — 1 is the same as in (14.171) . but the terms with k > 2 are different. 
Note that the expression need not be unique since we are not performing a naive power 
series expansion. We have preliminary numerical evidences (in the Langevin models) which 
suggest that the series converges most efficiently when we set a = 1/2 and use (I4.17p . 



4.3 Order estimate 

Let us show that, as we have noted in (13.71) . the representation (14.171) truncated to include 
only the k = 1 terms gives a result which is precise to the second order in the "order of 
nonequilibrium" e. 

For this purpose we first note a well-known time-reversal symmetry in the equilibrium 
case with e = 0, where the inverse temperatures of all the heat baths are identical to /3 eq 
and the time evolution T is completely determined by the static Hamiltonian i? sta t(r) of 
(12. ip . Then one has V^(r) = H stat (T(T)) — H stSut (T) = from the energy conservation, and 
A /3i = j3i — j3 eq = 0. Thus the nonequilibrium entropy production of (I3.10P is vanishing. 
This, with (EE]), implies that Q(T) = -(3 eq {H s ((T(T)) s )-H s (T s )}. Therefore Q(T) is entirely 
determined by the initial and the final states of the system, and shows no fluctuation within 
the averages (• • • ) 1/)7 or (• • • ) 7 *^«. Thus in the identity (14.21) . e _6,//2 simply cancel out and 
we have 

(f)Z° = {f%=l* ( 4 - 22 ) 

for any function /(■). 

Let us evaluate the k = 2 terms of (14.111) . Note that (13.91) implies $ ex (r) = ex (r) + 
(3 eq {H s ((T(T)) s ) - H S (T S )}. Since the term P eq {H s ((T(T)) s ) - H S (T S )} is a constant in 
the conditioned average (12.141) . we see from (I4.10p that the second order terms in (14.111) 
are written as (1/8 times) (($ ex ) 2 )^ 7 — (($ e x) 2 ) 7 *^. • Expanding this quantity around the 
equilibrium, one finds 

<($cx)X - <($ex) 2 )^ = (($ex) 2 ) C ;; 7 =° " (($ex) 2 )^ + 0( £ 3 ), 

where the correction is 0(e 3 ) because $ ex itself is a quantity of 0(e). By using (I4.10p . we 
replace $ ex by $ to write 

= ($ 2 )^ =0 - ($ 2 > 7 ', e =? + 0(e 3 ) (4.23) 
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But by using (I4.22p and & = — $, we see that the first and the second terms in the right-hand 
side of (14.231) cancel with each other. Thus the k = 2 terms have only 0(e 3 ) contribution. 
Since the terms with k > 3 obviously are 0(e 3 ), we have shown the desired claim. 

4.4 More on cumulants 

Let us complete some estimates related to cumulant. 

We begin by introducing a general definition and a new notation. For k random variables 
Xi, X 2 , . . . , X k , we define their cumulant by 



<*il X 2 ; ■ ■ ■ ; X k ) := — — -.. — log(exp[^ u % X t ]) 

i=l 



(4.24) 



-ui~=0 



The previous definition (14.71) is a special case of the present one. It is easily seen that one 
has 

(Y k ) c = { ¥■¥■ ■ ■■ ;Y ). (4.25) 

k 

One easily find that the relation 

{X x + X[;X 2 ;---;X k ) = (X 1 ; X 2 ; ■ ■ ■ ; X k ) + (X[; X 2 ; ■ ■ ■ ; X fc ) (4.26) 

holds and that the cumulant is invariant under permutation of the order of XiS. 
Using the integral representation H 3 . 2 f) . we can write the cumulant of interest as 

\k\c 



(0 ) c ,, 7 =/ dh dt 2 --- dt^ait^-aih)---- -a(t k )) un (4.27) 
Jo Jo Jo 

It is reasonable to expect that the time evolution within the system resembles that of a 
stochastic process with a finite relaxation time. More precisely we assume that there is a 
finite relaxation time3 r and finite constants C 2 , C3, . . ., and one has 

IW;g(t 2 );- Mtk))»„\ <C k exp[- maX ^ lU ~^ ] (4.28) 

T 

for any 7, v G S s and any tx,t 2 , . . . , t k , provided that k > 2. 

We choose and fix r* such that r* 3> r. We assume that T is large enough to satisfy 

T > T*. 



7 It is well-known that most (stochastic) systems of particle exhibit power law decay of correlations, 
known as "long-time tail" , in the infinite volume limit. If a system is finite, however, one generally has an 
exponential decay, where the relaxation time r is typically very large and diverges in the infinite volume 
limit. 
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We shall evaluate (14.270 by decomposing the whole time interval to three regions [0, r*\, 
(r*, T — t*), and [T — r*, T] to see that the cumulant in question can be decomposed nicely 
as in ( 14.321) . Let us define the integral for the initial region 

C it= / dh dt 2 --- dt k (a{t x )-a{t 2 )-----a{t k )) ua (4.29) 



Although the definition contains 7, we see from the the assumptions (I4.28P and T ^> r* ^> r 
that the 7 dependence can be neglected. Likewise the integral for the final region 



7 7 n = / dt ± dt 2 --- tM<7(*i);<7(* 2 );--- \p{tk))va (4.30) 

JT-T* JT-t* JT-t* 

should depend only on 7. Finally the integral of the intermediate region is 



rint 



dh ■ ■ ■ dt k (a(ti);a(t 2 ); ■ ■ ■ ; cr(t k )) vn (4.31) 

(h,...,t k )GK 



where K C [0,T] fc is the region which remains to be integrated, i.e., the set in which 
ti G (r*,T — r*) for at least one z or tj G [0, r*], tj G [T — r*,T] for at least one pair 
i, j. Again the assumptions (14.281) and r* ^> r imply that (I4.3ip is independent of u, 7. To 
see this, it suffices to note that the contribution to (14.311) from (t%, . . . ,t k ) in which at least 
one of them satisfies ti G [0, r*/2] or t i G [T — r*/2, T] is negligible. Of course these integrals 
sum up to be the desired cumulant as 

(Q% y = If* + J int + If. (4.32) 

When T grows with r* fixed, the intermediate integral J mt grows linearly in T while J™* 
and remain unchanged. 

By using the decomposition (|4.32|) . the desired (14. 15j) follows immediately. The property 
of ((0cx) fc )st, 7 and ((e ex ) fc ) 7 ., s t stated below (HTTI) also follows. 



5 Steady state with particle flow 

In the present section, we discuss representations for the stationary distribution of a nonequi- 
librium steady state with a steady flow of particles. Such nonequilibrium states can be 
modeled by a system attached to multiple particle baths (reservoirs) with different chemical 
potentials as in (4) of Fig. [31 As one may guess, the situation is very close to the problem 
of heat conduction, but one must consider the particle flow in addition to the energy flow. 
Consequently the entropy production should be defined as in (15.131) . which takes into account 
the entropy production by transfer of particles as well as that by energy transfer. With this 
modification, we get almost the same representations as in (15.161) and (15.201) . 
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5.1 States and Hamiltonians 

Let us refine our notation so that we can treat the situation where particles move between 
different parts. 

We again consider a classical system of many particles. We assume for simplicity that all 
particles are identical. Note that particles are always distinguishable in classical mechanics. 
As is always done in classical statistical mechanics, we introduce suitable combinatorial 
factors and relabeling so that to treat the particles as if they are indistinguishable. 

Again the whole system consists of a "system" and n particle baths (reservoirs). Let 
be the phase space of the whole system with N particles. A state in is still written 
as T = (7*1, . . . , r N ; p u . . . , p N ), but now the position r ; of the /-th particle may be in the 
system or in one of the n reservoirs. By N S (T) and iVj(r), we denote the numbers of the 
particles in the system and the i-th reservoir, respectively, in the state T. One thus have 
N = N S (T) + Yli=x -^i(r) if r e S^ N \ For a given T, we denote by T s the state obtained by 
extracting the coordinates and momenta of those particles contained in the system. By Tj 
we denote the state obtained by doing the same for the i-th reservoir. 

As in ( 12. ip . the Hamiltonian of the whole system is written as 

n 

iWr) = # s (r s ) + ^{^ b) (r,) + ^ c) (r,, r s )}, (5.1) 

where H S (T S ), H^iTi), and H^ c '(Ti, T s ) are the Hamiltonians for the system, the i-th reser- 
voir, and the coupling between the i-th reservoir and the system, respectively. We assume 
that all the Hamiltonians satisfy the time-reversal symmetry H(T) = H(T*). We can again 
consider the standard choice as in (12. 3p . (12.41) . and (12. 5p (with suitable rearrangement of the 
labels of the particles). 

Again it is standard to consider the weak coupling limit, in which one neg lectstff^r^). 
Let us remark that one may set exactly H^(Ti, T s ) = and still have a meaningful model 
where the system and the reservoirs effectively interact with each other. For this, we take 
a rather artificial model in which particles in the system do not interact with those in 
the reservoirs. Particles can interact with each other in each reservoir or in the system. 
Particles still move between the system and the reservoirs, thus generating (not necessarily 
weak) effective interactions between them. 

We again write 

^(r) = ^ b) (r J ) + ^ c) (r l ,r s ). (5.2) 

By T(-), we denote the time evolution map from t = to t = T determined by the pure 
Hamiltonian dynamics with the static Hamiltonian (15. ip . If necessary one can further add 
a non-conservative force or an oscillating external force to the present setting as in the 
examples 2 and 3 of section 12.51 
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5.2 Initial state and the steady state 



We now define our initial state. We assign the inverse temperature fa and the chemical 
potential /ij to the z-th reservoir. 

Let <S S consist of states (r^, . . . , r^; p± \ . . . , p^J where all (j = 1, . . . , N s ) are in 

the system. In short, <S S is the state space of the system, where the labels of the particles 
happen to be 1, ... , N s . 

We take an arbitrary particle number N s and a state v G Ss Ns ^ of the system. Then, as 
in (12. 8p . we take the following initial distribution in which the system is in the fixed state v 
(after a possible relabeling) and the states of the reservoirs are distributed according to the 
grand canonical ensemble with the specified fa and 



p„(T) :=5>(r s -C{v)) 



1 



,09,/*) 



exp [- A {H^ (T 4 ) + flf c) (T*, i/) - /* iV,(r)}j . (5.3) 



i=l 



Note that we are considering an ensemble which contains various N. We set P V {T) = 
for T G 5^ with iV < iV s . Here £ is a map which changes the labels of the parti- 
cles from (1, 2, . . . , N s ) to an arbitrary (ordered and non-overlapping) sequence chosen from 
(1, 2, . . . , N). In (15. 3p . £ is summed over N\/(N — iV s )! such relabelings. 
The grand partition function B. V (J3, /t) is determined by the normalization 



jv=o 



EL w.w^- 



From O, ([53]) and Q, we get@ 



S„(/3,/i) = £ / Tn 5 ( r s -^)) ^P - ^ {HW-lnNtf)} 

N=N B C ^^ s(N) ■ i=1 

Since the result of the integration does not depend on £, we have 



(5.4) 



dT 



(N-N B )\J resm N\ 



5(T S - v) exp [- £ a {^(r) - ^ iV,(r)} 



i=l 



E 

AT=JV B 

E /f! ex p|-E^^ b) (n)+^ c) ( r >)-^^(ro} 



7V'=0 



1=1 



What follows is a standard manipulation we always encounter when treating classical identical particles. 
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where N' = N—N s , and T' is integrated over all the states T' = (rjv s +i, . . . , r^', Pn b +ii • • • > Pjv) 
where all Vj are in the reservoirs. We now decompose N' as N' = Y^=i ^ where iVj is the 
number of particles in the z-th bath. Then we further get 

= t ttW I w exp [- E ft <^ b, ( r <) + ff ' c) ( r « ") - « *<>] > 

N u -,N„=0 iil J ^ J ^' i=l 

where (with a slight abuse of notation) Tj is integrated over the states (rj, . . . , r^; Pi, • • • , Pjy) 
where all are in the z-th reservoir. The factor (X^-^)V Yii counts the ways of dis- 
tributing the particles to the reservoirs. This factorizes into a product of equilibrium grand 
partition functions (with the boundary condition v) as 

= 11 / ^^[-^{H^iT^+H^iT^u)-^^}]. (5.5) 
i=i J iV 

We again define the corresponding grand partition function without coupling terms as 
S(/3 )M ) := f[ / ffexp[-A{^ b) (r 4 ) -/i.iVj], (5.6) 

i=l 

and the "free energy" of the coupling as 

^ j (z/) := - log — -. (5.7) 

-(Aw 

As before, <// c )(z/) is an equilibrium quantity which vanishes in the weak coupling limit. 

We shall fix the final condition for the system by taking an arbitrary N' s and the corre- 
sponding state 7 e <Si of the system. We define 

Pud) ■= £ / -t=f„(t) J>[(T(r)) s -£'( 7 )], (5.8) 



where £' is summed over all possible relabelings as in (15. 3p . Note that p v {^f) is normalized 



as 



M s =0 

for any ia To see this we observe that 



/" 7 ^ ^ e r-p v, JM S ! if T s contains M s particles 

Ae5 a (Ms) 7/ 10 otherwise 
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for any T, and recall the normalization (15.41) . 

For an arbitrary function f(T) (where T is an element of S^ N ' with variable N), we define 
the average 

</)- - ^ | L», M /(r) ft(r) |» (T(r)) - " £,(7)l ' (5 ' n) 

in which the initial and the final states of the system are fixed. 

Again we assume that the reservoirs are so large and T is so large that we can set 

P,(7)=Pst(7) (5.12) 

for any v, where p s t{l) is the stationary distribution for the unique nonequilibrium steady 
state. Partially conditioned averages (f) v ,st and (/)st, 7 are defined as (12.151) and (12.16j) . 
respectively. 

5.3 Entropy production and the representation of /0 s t(7) 
We now define the entropy production in the trajectory T -w T(T) as 

n 

0(T) := i A [Hi{T{T)) - Hi(T)} - fani [Ni(T(T)) - N t (T)]} , (5.13) 

i=l 

where Hi(T) is the Hamiltonian for the i-th reservoir defined in (15.21) . This is the total 
entropy production which takes into account the transfer of particles as well as that of 
energy. 

For an arbitrary function f(T), we can show the identity 

3,^(7) (/e- 0/2 ),, 7 = H 7 *p 7 *(0 (/V / 2 )^, (5.14) 

for any N s , M s and any v G <S S , 7 G Ss Ms \ This identity precisely corresponds to (14. ip . 
To derive ( 15.141) . we first note that the definitions (15.31) and ( 15.111) imply 

00 „ ,-p n 

E vP M(f) m = Yl / ^/(r)fflq)[-X;ft{^i(r)-A*i^(r)}]x 

7V=0 ^ re5(iV) ' i=l 

x^5(r s -c{v)) 5[(r(r)) s -£'( 7 )], (5.15) 

which corresponds to (14. 3p . Then (15.141) can be derived in essentially the same way as (14. ip . 
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By starting from (15.141) and repeating the derivation in sections 14.21 and I4.3[ we get the 
desired representation 

M7) = ^ (0) + <^ (C) (7) + ~{<©ex> 7 * )S t - (e cx ) sti7 } + 0(e 3 ), (5.16) 

where we wrote <£> s t(7) := — ^ogp at (j). Here (f^ is a constant independent of 7, and ^^(7) 
is the free energy for coupling defined in (15.71) . We recall that there are sensible models in 
which ^^(7) are vanishing. The excess entropy production is of course defined as ex (r) = 
0(r) — WT, where a is the entropy production rate. See section [37T1 

The representation (15.161) may be most useful in the situation where all the reservoirs 
have the same inverse temperature. Let us set $ = (3 for i = 1, . . . ,n, and note that the 
energy conservation implies 

n 

J2HHi(nr))-Hi(r)} = (3{H S (T S )-H S ((T(T)) S )}. (5.17) 

8=1 

Then the entropy production ( 15.131) is written as 

0(r) = P {H S (T S ) - H S ((T(T)) S )} + *(r), (5.18) 

where 

n 

vtr(r) = -PY, (5-19) 

8=1 

is the entropy production due to the transfer of particles. Substituting (15 . 1 8[) into the 
representation (15. 16ft . we get 

Ml) = ¥> W + V [c) (l) +PH s (-f) + ^ cx ) 7 . st - (^ cx ) st , 7 } + 0(e 3 ). (5.20) 

The constant is given by v? (1) = <£ (0) - (3 H s where H s = J2n s =o I^ €S ( n ^ ( d l / n ^-) Pst(l) H a (j) 
is the expectation value of the energy in the steady state. The excess quantity is again 
defined as ^ ex (r) = ^(T)-aT. 

It is an easy exercise to rewrite, as we have done in section I3.3[ the representations 
( I5.16P and (I5.2(jp in the forms where the contributions from the equilibrium grand canonical 
distribution becomes manifest. 
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